Søren Qvist Jensen
Jörg Müller
ABSTRACT
We present Inpher, a virtual reality system for setting physical properties of virtual objects using mid-air interaction. Users simply grasp virtual objects and mimic their desired physical movement. The physical properties required to fulfill that movement will then be inferred directly from that motion. We provide a 3D user interface that does not require users to have an abstract model of physical properties. Our approach leverages users' real world experiences with physics. We conducted a bodystorming to investigate users' mental model of physics. Based on our iterative design process, we implemented techniques for inferring mass, bounciness and friction. We conducted a case study with 15 participants with varying levels of physics education. The results indicate that users are capable of demonstrating the required interactions and achieve satisfying results.
Supplemental Material
- 2017. Unity 3D. (July 2017). https://unity3d.com/.Google Scholar
- R. Abraham and J.E. Marsden. 1978. Foundations of Mechanics. AMS Chelsea Pub./American Mathematical Society. https://books.google.co.uk/books?id=4Y-ownk6ilsCGoogle Scholar
- Priyanshu Agarwal, Suren Kumar, Jason J Corso, and Venkat Krovi. 2011. Estimating dynamics on-the-fly using monocular video. In Proceedings of 4th Annual Dynamic Systems and Control Conference.Google ScholarCross Ref
- Brenna D Argall, Sonia Chernova, Manuela Veloso, and Brett Browning. 2009. A survey of robot learning from demonstration. Robotics and autonomous systems 57, 5 (2009), 469--483. Google ScholarDigital Library
- AxeyWorks. 2017. Low Poly: Free Pack. (May 2017). https://www.assetstore.unity3d.com/en/#!/content/58821.Google Scholar
- Kiran S Bhat, Steven M Seitz, Jovan Popović, and Pradeep K Khosla. 2002. Computing the physical parameters of rigid-body motion from video. In European Conference on Computer Vision. Springer, 551--565. Google ScholarDigital Library
- Aude G Billard, Sylvain Calinon, and Florent Guenter. 2006. Discriminative and adaptive imitation in uni-manual and bi-manual tasks. Robotics and Autonomous Systems 54, 5 (2006), 370--384.Google ScholarCross Ref
- Evren Bozgeyikli, Andrew Raij, Srinivas Katkoori, and Rajiv Dubey. 2016. Point&Teleport Locomotion Technique for Virtual Reality. In Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in Play (CHI PLAY '16). ACM, New York, NY, USA, 205--216. Google ScholarDigital Library
- Andreas Fender, Jörg Müller, and David Lindlbauer. 2015. Creature teacher: A performance-based animation system for creating cyclic movements. In Proceedings of the 3rd ACM Symposium on Spatial User Interaction. ACM, 113--122. Google ScholarDigital Library
- HTC. 2017. Vive. (July 2017). https://www.vive.com.Google Scholar
- Auke Jan Ijspeert, Jun Nakanishi, and Stefan Schaal. 2002. Movement imitation with nonlinear dynamical systems in humanoid robots. In Robotics and Automation, 2002. Proceedings. ICRA'02. IEEE International Conference on, Vol. 2. IEEE, 1398--1403.Google ScholarCross Ref
- Joseph Laszlo, Michiel van de Panne, and Eugene Fiume. 2000. Interactive control for physically-based animation. In Proceedings of the 27th annual conference on Computer graphics and interactive techniques (SIGGRAPH '00). ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, 201--208. Google ScholarDigital Library
- C Karen Liu, Aaron Hertzmann, and Zoran Popović. 2005. Learning physics-based motion style with nonlinear inverse optimization. ACM Transactions on Graphics (TOG) 24, 3 (2005), 1071--1081. Google ScholarDigital Library
- NVidia. 2017. PhysX. (July 2017). https://developer.nvidia.com/physx-sdk.Google Scholar
- Antti Oulasvirta, Esko Kurvinen, and Tomi Kankainen. 2003. Understanding contexts by being there: case studies in bodystorming. Personal and ubiquitous computing 7, 2 (2003), 125--134. Google ScholarDigital Library
- Nancy S Pollard and Jessica K Hodgins. 2004. Generalizing demonstrated manipulation tasks. In Algorithmic Foundations of Robotics V. Springer, 523--539.Google Scholar
- Jovan Popović, Steven M Seitz, and Michael Erdmann. 2003. Motion sketching for control of rigid-body simulations. ACM Transactions on Graphics (TOG) 22, 4 (2003), 1034--1054. Google ScholarDigital Library
- Jovan Popović, Steven M Seitz, Michael Erdmann, Zoran Popović, and Andrew Witkin. 2000. Interactive manipulation of rigid body simulations. In Proceedings of the 27th annual conference on Computer graphics and interactive techniques. ACM Press/Addison-Wesley Publishing Co., 209--217. Google ScholarDigital Library
- Jia Sheng, Ravin Balakrishnan, and Karan Singh. 2006. An interface for virtual 3D sculpting via physical proxy.. In GRAPHITE, Vol. 6. 213--220. Google ScholarDigital Library
- Jia Wang, Owen Leach, and Robert W Lindeman. 2013. DIY World Builder: an immersive level-editing system. In 3D User Interfaces (3DUI), 2013 IEEE Symposium on. IEEE, 195--196.Google Scholar
- Jiajun Wu, Joseph J Lim, Hongyi Zhang, Joshua B Tenenbaum, and William T Freeman. 2016. Physics 101: Learning Physical Object Properties from Unlabeled Videos. In BMVC.Google Scholar
Index Terms
- Inpher: Inferring Physical Properties of Virtual Objects from Mid-Air Interaction
Recommendations
Towards VR and AR: 360° light field display with mid-air interaction
SA '16: SIGGRAPH ASIA 2016 Emerging TechnologiesWe present a 360° light field display to visualize 3D objects above the table-top screen, and provide a graspable and measurable virtual or augmented reality environment. The display is constructed by a spinning flat-plate deflected diffuser screen, a ...
Vulture: a mid-air word-gesture keyboard
CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsWord-gesture keyboards enable fast text entry by letting users draw the shape of a word on the input surface. Such keyboards have been used extensively for touch devices, but not in mid-air, even though their fluent gestural input seems well suited for ...
Tangible Holographic 3D Objects with Virtual Touch
ITS '15: Proceedings of the 2015 International Conference on Interactive Tabletops & SurfacesThis poster describes the design of a display and interaction device that allows a natural mid-air manipulation and feedback of floating, true 3D objects. This so called virtual touch will create a natural feeling of manipulating and touching of the ...
Comments